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© Automatic control of image pick-up position to object. 



(57) A method of automatically controlling an image 
pick-up position of an object includes the steps of 
compressively coding the derived image data and 
producing valid image data; dividing an image plane 
into a plurality of divisional areas by lines passing 
through the center of the image plane, counting the 



number of valid image data, producing information 
on a position to which a calculation of image data is 
directed, deciding the direction determined by the 
highest count among the counting results, and in- 
structing a direction of motion of a camera rotation 
table (13) based on the direction decision. 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to a method and 
an apparatus for automatically controlling an image 
pick-up position of an object. The method and 
apparatus according to the present invention are 
used for an automatic control of the direction of a 
camera placed on a camera rotation table as an 
image picking-up device used in a television con- 
ference system, in the camera direction presetting 
manner. 

DESCRIPTION OF THE RELATED ARTS 

In a television conference system, the trans- 
mission of images is carried out by transmitting the 
image of the entire scene of a conference room, 
and by transmitting images of the faces of in- 
dividuals participating in the television conference. 

One method of transmitting the image of the 
face of an individual is to preregister the positions 
of the persons on whom a pick-up camera is to be 
focused, to assign an identification number to each 
of the preset positions, and to direct the pick-up 
camera by designating one of the identification 
numbers for directing the pick-up camera to the 
person to whom the pick-up camera is to be di- 
rected. This method is called the preset system. 

In the preset system, often the person does not 
sit exactly in the registered position but sits at a 
position slightly away from the registered position. 
In this case, if a fine control of the direction of the 
pick-up camera can be made by an operation of a 
remote control device, but a problem arises in that 
such a fine control of the direction of the pick-up 
camera is time-consuming and troublesome, and 
accordingly, an efficient operation of the picking-up 
and the transmission of images during a television 
conference system is impossible. 

SUMMARY OF THE INVENTION 

Therefore, an object of the invention is to pro- 
vide an improved method and apparatus for an 
automatic control of a pick-up position of an object 
during a television conference system in which the 
direction of a pick-up camera is automatically con- 
trolled so that the pick-up camera is exactly di- 
rected to produce an image of a scene whereat the 
image of the desired person is situated in the 
center of the image, and accordingly, an efficient 
operation of the picking-up and transmission of 
images during a television conference system is 
realized. 



In accordance with the present invention, there 
is provided a method of automatically controlling 
an image pick-up position of an object, including 
the steps of: picking up images of an object and 

5 producing data of images therefrom; compressively 
coding the derived image data and producing valid 
image data; dividing an image plane into a plurality 
of divisional areas by lines passing through the 
center of. the image plane; counting the number of 

w valid image data; producing information on a posi- 
tion for which a calculation of image data is di- 
rected; deciding a direction determined by the ma- 
jority of counts from the result of the counting; 
instructing a motion direction of a camera rotation 

15 table based on the direction decision; and control- 
ling the motion of the camera rotation table in 
accordance with the direction of motion instruction. 

In accordance with the present invention there 
is also provided an apparatus for automatically 

20 controlling an image pick-up position of an object 
including: an image pick-up camera for picking up 
an image of an object; a camera rotation table for 
placing a camera thereon and rotating the camera; 
a data compressive coding device for compres- 

25 sively coding data of an image picked up by the 
image pick-up camera; an image plane division 
device for dividing an image plane by lines passing 
through the center of the image plane; a counter 
for counting the number of valid image data; a 

30 position information production device for produc-' 
ing information on a position to which a calculation 
of image data is directed; a motion direction de- 
cision device for deciding a direction of motion of 
the camera rotation table, and a motion control 

35 device for controlling the motion of the camera 
rotation table in accordance with the decided direc- 
tion. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 

Figure 1 illustrates a prior art image data com- 
pressive transmission system of the inter-frame 
image data difference transmission type; 
Fig. 2 illustrates a prior art image data compres- 

45 sive transmission system of the intra-frame im- 
age data difference transmission type; 
Fig. 3 illustrates a prior art image data compres- 
sive transmission system using an image data 
difference for each block of an image plane; 

so Fig. 4 illustrates a prior art image data compres- 
sive transmission system using an inter-frame 
motion-compensating type coding for each 
block of an image plane; 

Fig. 5 illustrates an example of a sequence of 
55 picking-up images of persons at a television 
conference; 
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Fig. 6 is a schematic diagram of an apparatus 
for carrying out a method according to an em- 
bodiment of the present invention; 
Fig. 7 is a schematic diagram of an apparatus 
for carrying out a method according to another 
embodiment of the present invention; 
Fig. 8 is a schematic diagram of an apparatus 
for carrying cut a method according to another 
embodiment of the present invention; 
Fig. 9 is a schematic diagram of an apparatus 
for carrying out a method according to a still 
another embodiment of the present invention; 
and 

Fig. 10 illustrates an example of the dividing of 
an image plane. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Before describing the preferred embodiments 
of the present invention, prior art image data com- 
pressive transmission systems using inter-frame 
image difference data, intra-frame image difference 
data, an image data difference for each block of an 
image plane, and an inter-frame motion-compen- 
sating type coding for each block of an image 
plane will be explained with reference to Figs. 1 to 
4. Also, an example of a sequence of picking-up of 
images of persons at a television conference will 
be explained with reference to Fig, 5. 

In an inter-frame image data difference trans- 
mission system shown in Fig. 1, only an inter- 
frame difference of image data between two suc- 
cessive frames is transmitted when reproducing the 
images in the frames at the receiver. 

In an intra-frame image data difference trans- 
mission system shown in Fig. 2, only a difference 
of pixel data between two successive pixels is 
transmitted when reproducing the images in the 
frames at the receiver. 

In a system transmitting an image data dif- 
ference for each block of an image plane shown in 
Fig. 3, only a difference of data between two suc- 
cessive blocks is transmitted when reproducing the 
images in the frames at the receiver. 

In an inter-frame motion-compensating type 
coding system for each block of an image plane 
shown in Fig. 4, only an integrated value of differ- 
ences between data of pixels of a block and an 
estimated block and information on a motion vector 
between blocks are transmitted to reproduce the 
images in ~the~frames at ~th~e " receiver. "The inter- 
frame motion compensating type coding technique 
is described, for example, in Japanese Examined 
Patent Publication (Kokoku) No. 2-20196. 

In a sequence of picking-up images of persons 
at a television conference as shown in Fig. 5, 
where the pick-up camera is directed to person-D 



(STEP-1), if the image of person A is to be picked 
up, the pick-up camera is directed to person-A in 
the camera direction presetting manner (STEP-2). 
If person-A is not present exactly at the registered 

5 position but is at a position shifted from the regis- 
tered position, the image of person-A is not pro- 
duced in the center of the image plane as shown in 
STEP-2 of Fig. 5. Therefore, to bring the image of 
person-A to the center of the image plane, it is 

10 necessary to adjust the direction of the pick-up 
camera by an operation of a remote control device 
as shown in STEP-3 of Fig. 5. 

A schematic diagram of an apparatus for carry- 
ing out a method of automatically controlling an 

/5 image pick-up position of an object according to an 
embodiment of the present invention, of the inter- 
frame image data difference transmission type, is 
shown in Fig. 6. The apparatus of Fig. 6 is con- 
stituted by a camera 12 having an electromotive 

20 lens 11, a camera rotating table 13, a coding de- 
vice 2 having an analog to digital converter 21, 
frame storages 221, 222, ... 22n, an inter-frame 
difference calculation portion 23, and a variable 
length coding portion 27, a valid/invalid decision 

25 portion 3, a coding/decoding control portion 4, a 
position data decoder 5, a motion direction de- 
cision device 6 having AND gates 611, 612, 613, 
and 614, counters 621, 622, 623, and 624, a com- 
parison portion 63, and a table controller 7. 

30 The principle of the operation of the apparatus 

of Fig. 6 is based on the fact that the target person 
cannot remain motionless but must occasionally 
move, and accordingly, the inter-frame difference 
of the image of the target person must be in- 

35 creased in accordance with a movement of the 
target person. Thus, it is possible to direct the 
camera to a position in the image plane at which 
the inter-frame difference is increased. 

The signal of the image picked up by camera 

40 12 having an electromotive lens 11 is converted by 
an analog-to-digital converter 21 into digital signals, 
which are successively stored in frame storages 
221, 222, ... 22n. The differences between the 
frame storages 221, 222, ... 22n are calculated at 

45 an inter-frame difference calculation portion 23 for 
each pixel, the result of the calculation is variable 
length coded in a variable length coding portion 27, 
and the coded signal is delivered to the transmis- 
sion line. 

so The difference data produced by the inter- 

frame difference calculation portion 23 is supplied 

to a' valid/invalid^ decision portion -3- in-whieh -the 

supplied data is compared with predetermined data 
as threshold value data supplied from the 

55 coding/decoding control portion 4, which controls 
the analog-to-digital converter 21, the frame stor- 
ages 221. 222, ... 22n, and the variable length 
coding portion 27. The valid data is delivered from 
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the valid/invalid decision portion 3 when the sup- 
plied data is greater than the threshold value data. 
The valid data from the valid/invalid decision por- 
tion 3 and the data of the calculated position in the 
image plane output by the position data decoder 5, 
which receives the data of the calculated position 
in the image plane from the inter-frame difference 
calculation portion 23, are supplied to the motion 
direction decision device 6. 

In the motion direction decision device 6, the 
counting of the valid data for each of four divisions 
of the image plane is carried out by counters 621, 
622, 623. and 624. The image plane is divided, for 
example, into four divisions, by lines passing 
through the center of the image plane as shown in 
Fig. 10. The outputs of the counters 621, 622, 623, 
and 624 are supplied to a comparison portion 63. 
The output of comparison portion 63, which is the 
result of a. comparison indicating the direction of 
motion corresponding to the highest count among 
the counters, is supplied to table controller 7. 

The output of the table controller 7 is supplied 
to the camera rotating table 13, which then rotates 
the camera 12 placed on camera rotating table 13, 
and thus camera 12 is rotated in the desired direc- 
tion. 

An apparatus according to another embodiment 
of the present invention is shown in Fig. 7. The 
apparatus of Fig. 7 is basically similar to the ap- 
paratus of Fig. 6, but the apparatus of Fig. 7 is an 
intra-frame image data difference transmission 
type. The principle of the operation of the appara- 
tus of Fig. 7 is based on the fact that the image of 
the background scene of a conference room is 
simpler, with- regard to a color density and bril- 
liance of an image, than the image of a target 
person, and therefore, the amount of information on 
the image of the target person is greater than that 
of the background scene, and accordingly, the 
intra-frame difference of the image of the target 
person must be increased. Therefore, it is possible 
to direct the camera to the position in the image 
plane at which the intra-frame difference is in- 
creased. 

The coding device 2 is constituted by an 
analog-to-digital "converter 21, a frame storage 22, 
an intra-frame difference calculation portion 24, and 
a variable length coding portion 27. 

In the intra-frame difference calculation portion 
24, the calculations of the intra-frame differences 
are carried out for each of the pixels stored in 
frame storage 22, and the output of the intra-frame 
difference calculation portion 23 is supplied to the 
valid/invalid decision portion 3. 

An apparatus according to another embodiment 
of the present invention is shown in Fig. 8. The 
apparatus of Fig. 8 is basically similar to the ap- 
paratus of Fig. 6, but the apparatus of Fig. 8 is a 



type which transmits an image data difference for 
each block of an image plane. The principle of the 
operation of the apparatus of Fig. 8 is based on the 
fact that the inter-block difference is increased as 
5 the target person moves. Thus, it is possible to 
direct the camera to the position in the image 
plane at which the intra-frame difference is in- 
creased. 

In the coding calculation portion for each block 

;o 25, the differences between data stored in the 
frame storages 221, 222. ... 22n. concerning 8x8 
pixels, 16x16 pixels, etc.. are calculated for each 
block, and the result of the calculation is compared 
with a predetermined value, as a threshold value. 

75 An apparatus according to still another embodi- 

ment of the present invention is shown in Fig. 9. 
The apparatus of Fig. 9 is basically similar to the 
apparatus of Fig. 6, but the apparatus of Fig. 9 is 
the coding of the inter-frame motion-compensating 

20 type for each block of an image plane. The princi- 
ple of operation of the apparatus of Fig. 9 is based 
on the fact that a target person must sometimes 
move, and accordingly, the number of valid blocks 
with motion vectors must be increased at the posi- 

25 tion of the target person in the image plane. Thus, 
it is possible to direct the camera to position in the 
image plane at which the number of blocks with 
motion vectors is increased. 

In the motion compensation estimation portion 

30 for each block 26, the differences between data 
stored in frame storages 221, 222, ... 22n, concern- 
ing 8 x 8 pixels, 16x16 pixels, etc., are calculated 
for each block, and the result of the calculation is 
compared with a predetermined value, as a thresh- 

35 old value. 

Claims 

1. A method of automatically controlling an image 
40 pick-up position of an object comprising the 

steps of: 

picking up images of an object and pro- 
ducing data of images therefrom; 

compressively coding the derived image 
45 data and producing valid image data; 

dividing an image plane into a plurality of 
divisional areas by lines passing through the 
center of the image plane; 

counting the number of valid image data; 
50 producing information on a position to 

which a calculation of image data is directed; 

deciding the direction determined by the 
highest count among the counting results; 

instructing a direction of motion of a cam- 
55 era rotation table based on the direction de- 

cision; and 
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controlling the motion of the camera rota- 
tion table in accordance with the direction of 
motion instruction. 

2. A method according to claim 1 further com- 
prising a step of deciding the validity of the 
image data. 

3. A method according to claim 2, wherein the 
decision on the validity of the image data is 
based on a comparison thereof with a pre- 
determined threshold value. 



70 



9. An apparatus according to claim 1, further 
comprising image data validity decision means 
for deciding the validity of the image difference 
data. 

10. An apparatus according to claim 2. wherein the 
decision of the image data validity by the data 
validity decision means is based on a compari- 
son thereof with a predetermined threshold val- 
ue. 



4. A method according to claim 3, wherein the 
compressive coding of image data is a com- 15 
pressive coding using inter-frame image dif- 
ference data. 

5. A method according to claim 3, wherein the 
compressive coding of image data is a com- 20 
pressive coding using intra-frame image dif- 
ference data. 

6. A method according to claim 3, wherein the 
compressive coding of image data is a com- 25 
pressive coding using image data difference 

for each block of an image plane. 

7. A method according to claim 3, wherein the 
compressive coding of image data is a com* 30 
pressive coding using an image motion com* . 
pensatory estimation value for each block of an 
image plane. 

8. An apparatus for automatically controlling an 35 
image pick-up position of an object compris- 
ing: 

an image pick-up camera for picking up an 
image of an object; 

a camera rotation table for placing a cam- 40 
era thereon and rotating the camera; 

data compressive coding means for com- 
pressively coding data of an image picked up 
by the image pick-up camera; 

image plane division means for dividing an 45 
image plane by lines passing through the cen- 
ter of the image plane; 

a counter for counting the number of valid 
image data; 

position information production means for so 
producing information on a position to which a 
calculation of image data is directed; 

motion direction decision means for decid- 
ing a direction of motion of the camera rotation 
table, and 55 

motion control means for controlling the 
motion of the camera rotation table in accor- 
dance with the decided direction. 
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